NAVAL POSTGRADUATE SCHOOL 

Monterey, California 




THESIS 

AGGREGATION OF MEASURES OF 
6 EFFECTIVENESS WITH CONSTANT SUM 

| SCALING METHOD AND MULTIPLE REGRESSION 

by 

Hyung Bae Kim 
March 1979 

Thesis Advisor: G. Lindsay 

Approved for public release; distribution unlimited. 



Thesis 

K4147 



DUDLEY KNOX LIBRARY 
NAVAL POSTGRADUATE SCHOOL 
MONTEREY. CA 93340 



NAVAL 



POSTGRADUATE SCHOOL 

Monterey, California 




THESIS 

AGGREGATION OF MEASURES OF 
EFFECTIVENESS WITH CONSTANT SUM 
SCALING METHOD AND MULTIPLE REGRESSION 

by 

Hyung Eae Kim 
March 1979 

Thesis Advisor: G. Lindsay - 

I 

Approved for public release; distribution unlimited. 




UMCLASSIEIED 



SECURITY CLASSIFICATION OF THIS PAGE (When Data Enfrod) 



REPORT DOCUMENTATION PAGE 


READ INSTRUCTIONS 
BEFORE COMPLETING FORM 


I. REPORT NUMBER 


2. GOVT ACCESSION NO. 


1. RECIPIENT'S CAT ALOG NUMBER 


4. TITLE Subtltla) 

Aggregation of Measures of Effectiveness 
with Constant Sum Scaling Method and 
Multiple Regression 


5- TYPE OF REPORT k PERIOD COVERED 

Master's Thesis; 

March 1979 


«. performing org. report number 


7. AUTHOR^ 

Hyung Bae Kim 


t. CONTRACT OR grant n U M ■ E Rf*J 


». performing organization name ano aoorcss 

Naval Postgraduate School 
Monterey, California 93940 


10. PROGRAM ELEMENT. PROJ CCT, TASK 

AREA k WORK UNIT NUMBERS 


1 1. CONTROLLING OFFICE NAME ANO AOORCSS 

Naval Postgraduate School 
Monterey, California 93940 


12. REPORT DATE 

March 1979 


11. NUMBER OF PAGES 

61 


r 4. MONITORING agency name a AOORESSfff dlllmront Irom Controlling Oltlemj 


IS. SECURITY Class. (Ol thtm report) 

Unclassified 


!»«. DECLASSIFICATION/ DOWNGRADING 
SC H E OU L £ 


IS. DISTRIBUTION STATEMENT (al thla Kap art) 

Approved for public release; distribution unlimited. 


17. DISTRIBUTION STATEMENT (ol ffiw oMmtrnct entered in Blnek 20, II dlllerent from Report) 


IS. SUPPLEMENTARY NOTES 


!9. KEY WORDS (Continue on reeeree mide il neceeeerr identify by block number) 

Weapon system effectiveness 


20. ABSTRACT (Continue an rereroe tide II neceeemy and Identity by block miiirj 

This thesis explores a method of aggregating the measures 
of effectiveness of a weapon system from its characteristics. 
With this method, the constant sum method and multiple 
regression are used to develop a functional relationship 
between system effectiveness and system characteristics. 

As an example, a study of a tank weapon system was conducted 



DD I jan*73 1473 COITIOM or I MOV •• is omolete UNCLASSIFIED 

(Page 1) S/N 0102-014-660 1 | 



SECURITY CLASSIFICATION OF THIS PAGE (When Dm to Entered) 



UNCLASSIFIED 




Approved for public release; distribution unlimited. 



AGGREGATION OF MEASURES OF EFFECTIVENESS WITH 
CONSTANT SUM SCALING METHOD AND MULTIPLE REGRESSION 



by 



Hyung 3ae Kim 

Lieutenant Colonel, Republic of Korea Army 
B.S., Korea Military Academy, 1963 



Submitted in partial fulfilment of the 
requirement for the degree of 



MASTER OF SCIENCE IN OPERATIONS RESEARCH 



from the 

NAVAL POSTGRADUATE SCHOOL 
March 1979 



s 

K >4 \ M T 
d > 



OUOUEY KNOX HORARY 
NAVAL POSTGRADUATE SCHOOL 
MONTEREY, CA 93940 



ABSTRACT 

This thesis explores a method of aggregating the 
measures of effectiveness of a weapon system from its 
characteristics. With this method, the constant sum method 
and multiple regression are used to develop a functional 
relationship between system effectiveness and system 
characteristics. As an example, a study of a tank weapon 
system was conducted with data from the U.S. Army Armor 
School. It was concluded that the aggregation method is 
feasible, and that for the tank system studied, the 
reciprocals of system characteristics give a good estimating 
equation for measuring tank system effectiveness. 
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I. 



INTRODUCTION 



We often find measurement problems in Operations 
Research that are difficult in that widely used concepts 
have not been made operational. How to measure the effec- 
tiveness of a weapon system is one of the most important 
tasks in military affairs. What is. needed is some method 
to give answers to such questions as "Which tank is more 
effective?", or "How much better a M60A1 is than a T-62?" 

We want to know how much better one weapon system is 
than another among similar systems. One way of doing this 
is through a functional relationship between system effec- 
tiveness and the characteristics of the system. 

In this paper we will propose and demonstrate a way of 
structuring such a relationship using as values for the 
effectiveness of weapon systems values which originally 
came from military experts' judgements. Once we have found 
such a function, we would not necessarily require experts 
judgements again, since one can use the function to calcu- 
late the effectiveness of a proposed weapon system from its 
characteristics . 

Chapter II gives the concept and general procedure of 
this approach to measuring effectiveness. For an illus- 
trative problem we will discuss the selection of the 
systems and their major characteristics, the preparation of 
questionnaires and the selection of "expert" judges. 



/ 



Using information from the judges, we will show in 
Chapter III how to compute the values of effectiveness of 
weapon systems using the constant sum method. In seeking 
a good functional relationship between systems effective- 
ness and system characteristics, we will use an APL computer 
program for multiple regression and explore various func- 
tional forms by transforming the data. This is the content 
of Chapter IV. In the final chapter, we will summarise 
major conclusions and observations during the course of 
this research. 

It must be emphasized that although the illustration 
study presented here involves the effectiveness of a main 
battle tank, our purpose is to demonstrate a proposed 
approach to the measurement of systems effectiveness, and 
not to develop effectiveness relationships for main battle 
tanks. A study of the latter type would require resources 
in excess of those available for this work. 
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II. DESIGN AND DATA COLLECTION 



This chapter describes the proposed method of finding a 
useful functional relationship between weapon system 
characteristics and the overall effectiveness of a system, 
and in particular describes and demonstrates the collection 
of data needed for this approach. First we will give the 
concept of the method and the general procedure we are going 
to follow. Then, using tanks as an example, we will discuss 
the selection of systems and their major characteristics, 
and comment about preparing questionnaires . 

A. CONCEPT OF THE PROBLEM 

The problem we are interested in is to calculate the 
overall effectiveness of a weapon system from its charac- 
teristics. The approach here will be to demonstrate how 
to estimate the effectiveness of a weapon system using a 
scaling method [1] . 

Every weapon system has its own characteristics and if 
we have a value for the overall effectiveness of that system, 
we should be able to obtain or fit a relationship expressing: 

Overall effectiveness _ _. v ,, v . 

of a weapon system 12 m 

where 

X.,X„, ..., X are system characteristics. 

12 m 




9 



The purpose of this paper is to show a procedure for 
obtaining values for overall effectiveness, and a way of 
determining the function f. Since we will be fitting func- 
tions to data, the more instances of the system we use, the 
better the functional relationship we can find. 

Figure 1 shows the relationship between characteristics 
and system effectiveness. 

SYSTEM CHARACTERISTICS 



INSTANCE 


EFFECTIVENESS 


X 1' X 2 


X m 


1 


Y 1 


X 11 ,X 12 


X lm 


2 


Y 2 


X 21' X 22 


2m 


3 




f ^ x 31' X 32 


3m 


n 


Y 

n 


x nl ' X n2 


nm 



FIG. 1 RELATIONSHIP BETWEEN EFFECTIVENESS 
AND CHARACTERISTICS 



There are n instances of the system and thus n effectiveness 

/ 

values which have to be obtained. The system has m char- 
acteristics which we presume to relate to effectiveness, 
and assume m < n. If we express this figure in a mathematical 
equation we would write: 






X. ) 

im 



( 2 ) 
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describing overall effectiveness of a system as a function 
of its characteristics, and we propose to show how to 
obtain values for the Y • , and how to find a good fitting 
function f. 

B. GENERAL STUDY PROCEDURE 

The general study procedure is composed of 3 steps. 

Step 1. Design of the study. In this step we have to 
select the instances of the system and the major charac- 
teristics of that system, and collect the data to provide 
characteristic values for each selected instance. A scaling 
method must then be chosen by which we can quantify information 
from judges about system effectiveness. After doing this, 
we prepare questionnaires and send them to selected judges 
to obtain information from them about the effectiveness 
of the system. 

Step 2. Computation of the effectiveness of each 
instance of the system. The questionniares sent to the 
judges are to obtain expert judgement, which may be expressed 
as a ranking of systems or as a ratio scale value of effec- 
tiveness, according to the requirement of the scaling method 
which has been selected. Based on this information, the 
next thing to do is to use the scaling method to compute 
the effectiveness of each instance of the system. 

Step 3. Determination of the functional relationship. 

Once we have the numberical values of effectiveness and the 
characteristics for each system, the next step is similar to 
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FIG. 2 PROCEDURE OF THE STUDY 



finding a cost estimating equation [2]. Because of many 
characteristics and instances of the system, it seems 
reasonable to use the multiple regression technique to 
find a good estimating equation. Since we will not restrict 
ourselves to the linear equation case, there are many 
candidate functions available by transforming the data. 
Therefore we have to choose the best functional relation- 
ship by evaluating these candidate equations. This whole 
procedure is represented in Figure 2 . 

C. DETAILED PROCEDURE 

We will discuss the elements of the design of the study 
in detail in this section. Steps 2 and 3 (computation of 
effectiveness and determination of a functional relationship) 
will be discussed in detail in Chapters III and IV. 

1 . Selection of the Competing Systems 

Among various types of weapon systems we could use 
as the example in this paper, let's consider the tank 
weapon system. What kind of tank should we choose? It 
depends on what we are going to do with the tanks, and since 
we want to decide which tank system is good for battle, we 
shall choose Main Battle Tanks (MBTs) [3]. 

We shall define Main Battle Tanks (MBTs) as the 
greatest number of tanks a country has for battle. For 
this study six Main Battle Tanks were chosen: 
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M48A5 



(Korea) , 



and 



M60A1 
AMX-30 
LEOPARD 1 
T-62 

CENTURION (Mk . 13 ) 



(U.S .A. ) , 
(France) , 

(W. Germany), 
(U.S .S .R. ) , 

(Great Britain). 



The reason why these tanks are chosen is that (1) these 
are all Main Battle Tanks that are currently in service, and 
(2) they are very well-known tanks so that the experts can 
give knowledgeable information. If some of the tanks were 
older ones not in service or tanks under development, some 
judges might not be familiar with them. 

As mentioned before, the more tanks used in the 
study, the better is the relationship that may be obtained. 

The reason for using only six MBTx here relates to the work- 
load that is placed on the judges. In the constant sum 
scaling method which we are going to use, each judge is 
asked to consider each possible pair of instances and split 
100 points between the two instances in each pair. Thus for 
n instances to be scaled, n(n-l)/2 pairs must be considered 
by each judge. Therefore we have to consider the number of 
instances to be scaled because the greater the number of 
instances, the greater the workload asked of each judge 
and the less careful he might be in his rating and the smaller 
proportion of questionnaires we would expect to be returned. 
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Since "the more judges the better" is particularly an axiom 

in scaling, tradeoffs may have to be made between the effort 

that will be required of a judge and the amount of confidence 

one wishes to have in the resulting scale. Our selection 

6 ( 5 — ]_ ) 

of six tanks (instances) requires — = 15 pairs of tanks 

to be considered, and this number is thought reasonable for 
a judge to handle in a short period of time. 

2 . Selection of the Major Characteristics 

There are of course many characteristics which 
affect the effectiveness of a system. For example, one 
source lists about 30 characteristics which are deemed 
relevant to the importance of a tank system [3] . 

Some of the characteristics have very similar values 
among various MBTs, and these characteristics should not 
make any substantial difference in the comparison of effec- 
tiveness among the competing systems. Thus we don't need to 
consider this kind of characteristic. 

We have chosen 4 tank characteristics as follows: 

1. speed 

2. silhouette 

3 . Hp/ton 

4 . armor . 

These characteristics are not necessarily the most important 
ones. For example, fire power is a very important considera- 
tion, but obtaining useful numerical data on fire power is 
very difficult due to a lack of a standard measurement criterion . 
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For fire power, we could consider the main gun, but all the 
selected Main Battle Tanks have a similar main gun with 
caliber 105 mm except T-62 which has 115 mm main gun. 

Therefore we have chosen the above characteristics as 
generally accepted important factors, which should serve 
well in our demonstration of a method for assessing system 
ef f ecti veness . 

3 . Collection of Data 

After selecting the system instances and the major 
characteristics for the study, we have to collect data for 
each characteristic. Table I shows the basic data [3] of the 
six Main Battle Tanks, which we will use. Clearly, one should 
use all the information sources available: manufacturer, 

military sources, or technical reports. 



Table I. CHARACTERISTICS OF SIX MAIN BATTLE TANKS [3] 



CHARACTERISTICS 

SYSTEMS 


ARMOR 

(mm on nose) 


SILHOUETTE 
(height in n) 


SPEED 
( km/hr ) 


H / ton 


LEOPARD 1 


70 


2.64 


65 


20 . 7 


M60A1 


110 


3.26 


48 . 3 


15.3 


T-62 


100 


2.4 


50 


19.2 


M4 8A5 


110 


3.09 


43.2 


15.9 


CENTURION 
(Mk .13) 


118 


3.01 


34.6 


12.5 


AMX-30 


48 


2.85 


65 


19.4 
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4. Selection of the Method 



There are many scaling methods we could use for our 
study such as a numerical method, the constant sum method, 
a comparative method, or a categorical method. For our 
study we want to know how much better one system is than 
another. In other words, we want a ratio scale that can be 
used for directly comparing two systems . 

Among those scaling methods the constant sum method 
will give a ratio scale which is easy to use. We can convert 
the information from judges about system effectiveness into 
a ratio scale. Therefore the constant sum method was chosen 
for the illustrative study of tank effectiveness. 

5 . Preparation of the Questionnaire 

This is one of the most important parts of the 
analysis. The questionnaire should be prepared very care- 
fully with a clear explanation of how to fill it out, 
together with information about the systems which the judges 
can use to assist them in their ratings. Since we are going 
to use the constant sum method to compute the effectiveness, 
the judges will be asked to make ratio scale judgements by 
splitting 100 points between the two instances represented 
by each possible pair of n tanks . ^ For example a judge 



Alternately, of course, one could gather information from 
a judge by asking for a numerical effectiveness rating for each 
tank, so that a judge would assign a number to each tank 
reflecting how effective he thought it was. This process, however, 
is a very difficult rating task for the judge. Literature in 
psychometrics suggests that judges will reflect their feelings 
more accurately, and with more confidence, if they are given just 
two instances at a time to rate, as in the constant sum method [1] . 
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might split the 100 points as 

M60A1 80_ T-6 2 2£ 

if he thinks M60A1 is much better (4 times in this example) 
than the T-62 or he might split the 100 points as 

M60A1 50 T-62 5£ 

if he thinks they are equal in terms of combat effectiveness. 

For our study we have six instances, and therefore 
there are 15 pairs to be presented to the judges (the ques- 
tionnaire which was used is shown in Appendix A) . 

The questionnaire actually used consisted of two 
parts, seeking ratings on both overall tank effectiveness 
and on the contribution to tank effectiveness of various 
characteristics . Scaled values from the second, supplemen- 
tary study are given in Appendix C and may be of interest 
to readers. 

6 . Selection of the Judges 

There appears to be no rule or standard for desig- 
nating individuals as "experts". It depends on common sense 
or military judgements. 

We believe that the armor officers in the U.S. Army 
Armor school may be considered experts about tanks. There- 
fore we selected them as judges and, after obtaining the 
gracious cooperation of the Armor School, sent 50 question- 
naires to them. The 50 questionnaires were completed by 
all ranks ranging from Lieutenant to flag officer, and all 
50 questionnaires were returned, ready for analysis. 
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So far in this paper we have structured the approach, 
selected the systems we are interested in evaluating, 
collected data on those systems, selected an analytic 
method and prepared the questionnaires for the judges. 

In the next chapter we will describe how the overall 
effectiveness values were computed from the information 
provided by the judges. 
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III. COMPUTATION OF SYSTEM EFFECTIVENESS 



In the previous chapter we showed how the model was 
organized, and how the questionnaires were prepared for the 
judges. In this chapter we will explain the constant sum 
scaling method of computing the overall effectiveness values 
for each system instance, using the information received 
from the judges. 

A. CALCULATION OF THE EFFECTIVENESS OF EACH WEAPON SYSTEM 

USING THE CONSTANT SUM SCALING METHOD 

The constant sum scaling method is designed to scale a 
property with a natural origin or an origin upon which the 
judges agree. Judges are asked to allocate 100 points 
between two instances, considering each possible pair of 
instances. Thus the resulting scale for instances of the 
property is taken as a ratio scale. In the following para- 
graphs we will explain how the scale values are obtained. 

Let a^j be the number of points out of 100 which a 
judge awards to instance j when it is compared to instance 
i. If we arrange a judge's responses in an array a^ , 
there will be one array for each judge in which values on 
the diagonal would be set at 50 because comparing something 
with itself should be 50:50. 

We could average these arrays over the N judges to 
produce an array a^j where 
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a . . 
1 D 



( 3 ) 



l 

over all judges 
N 



a 



ij 



and the values on the diagonal remain set at 50. Table III 



shows the a^^ values for this study, as computed from the 
data collected from 50 judges (the 50 a^^ arrays of individual 



judges are omitted) . 

From Table III one may see, for example, that the 
average of the judges' 100-point split in overall tank 
effectiveness between the T-62 and the AMX-30 was 55.9 for 
the T-62 and 44.1 for the AMX-30. 



Table III 


a . . 
13 


Array Computed from 


Judges ’ Responses 














CENTURIC 




M4 8A5 


M6 0A1 


AMX-30 


LEOPARD 


1 T-62 


(Mk. 13) 


M4 8A5 


50 


56.94 


45 . 1 


64 . 22 


54.7 


45.4 


M60A1 


43.06 


50 


39.14 


54 . 44 


45.04 


39 . 36 


AMX-30 


54.9 


60.86 


50 


63.86 


55.9 


49.7 


LEOPARD 1 


35.78 


45.56 


36.14 


50 


41.46 


37.54 


T-62 


45.3 


54.96 


44.1 


58.54 


50 


44 


CENTURION 


54.6 


60.64 


50.3 


62.46 


56 


50 



(Mk. 13) 



The next step is to construct a new W^j array where the 
entries are the ratios of the instance values across the 
diagonal, or 
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(4) 



= a— 



Of course the diagonal entries in the array should be 

1.0. In this array, it is immediately apparent that the 
entry in the ith row and jth column is the reciprocal of 
that in the jth row, and ith column, i.e.. 



W. 



ID 



1 

W. . 

Di 



(5) 



Values of w^j for the tank data were computed from the 
data in Table III, and are shown in Table IV. 



Table IV. W. . Array 
ID 





M48A5 


M60A1 


AMX-30 


LEOPARD 1 


T-62 


CENTURION 
(Mk . 13 ) 


M48A5 


1 


1.322 


.821 


1.735 


1.207 


.831 


M60A1 


.756 


1 


.643 


1.195 


.819 


.649 


MIX- 30 


1.217 


1. 555 


1 


1.767 


1.267 


.988 


LEOPARD 1 


.557 


.837 


.566 


1 


.708 


.601 


T-62 


.828 


1.220 


. 789 


1.412 


I 


.786 


CENTURION 
(Mk. 13) 


1.203 


1.541 


1.012 


1.664 


1.273 


1 


Since 


W . . is the 
ID 


ratio 


of the average points 


awarded 


to 



j (when compared to i) to the average points awarded to i 
(when compared to j), then in general, if and Sj are the 
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scale values we seek, W^ is an estimate of the ratio 
Sj/S^. Thus in terms of the Table IV data, for example, 
judges have indicated that they feel that the M60A1 tank 
is 1.322 times more effective than the M43A5 tank. The 
solution is overdetermined, however, since there are far 
more W. . ratios (fifteen) than there are scale values to 
be estimated (six). For example, one could also compare 
the M60A1 and the M48A5 by comparing both against the 
Leopard 1, and in this case the M60A1 would be judged 



0.837 

0.557 



= 1.503 



times better than the M48A5. 

We propose to handle this multiple estimate problem 
by a least squares approach over the estimates. 

We could write 



S . 



w ij = 



( 6 ) 



by taking the log of both sides of (6) , we have 



log Sj - log S j _ = log W^ , 



or 



log W. . - (log S . - locr S . ) = 0 . (7) 

^13 3 " 1 i 

For the least-squares approach we wish to obtain values of 
Sj and which will make 
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log W^j - (log Sj - log S^) 



close to zero over all instance pairs i,j. Thus we want 

to find values of S n ,S., . .., S such that 

12 n 

n n 

Q = l l [log - (log S j - log S.^)] 2 (8) 

i=l j=l 



in minimized. 

Algebraically expanding (8), we have 



n n 



Q = l I [log W ij - 2 log W^. log Sj + 2 log log S ± 

i=l j=l 

2 2 
+ log Sj - 2 log S . log + log S^] . 



In order to solve for the values of Sj which will minimize 
Q, we take the n partial derivatives of Q with respect to 
Sj and set them equal to zero. Thus 



n n 



9Q_ 

3S . 

3 



l l t- 

i=l j=l 



-2 log W. . 2 log S. 2 log S. 



1 D 



I _ 



s j 



s j 



S . 
3 



-1 = 0 , 



n n 

£ l [-log W^j+ log Sj - log S^] = 0 

i=l j=l 



n n 

l l log Sj 
i=l j=l 



n n 



n n 



l I log W ±j + l l log S i , 



i=l j=l 



i=l j=l 
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and finally. 



n n 

l log w ij l log s i 

log Sj = — ■ + — n , j = 1,2, n 

(9) 

Since the choice of a unit for the scale is arbitrary, 
we will choose one such that the average of the logs of 
the scale value is zero, or 

n 

l log s i 



Thus equation (9) becomes 

n 

l log W ±j 

log Sj = — - — , j = 1,2, ..., n . (10) 

The estimated scale values, , are given, of course, by 
the anti logarithms of 

n 

l log w 

i=l 

n 
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If we take the antilogarithms of 



n 



7 log W. . 
/. y 13 

i=l 

n 



equation (10) becomes 



n 

S. = II (W ±j ) 1/n , j = 1,2, n (11) 

i-1 

Therefore the scale value of instance j , S y derived from 
the least square approach can be interpreted simply as a 
Geometric mean of the jth column of the array. Using 

Table IV (W.^ array) and equation (11) , we obtained 3^ 
values as follows : 

= 0.89 

5 2 = 1.22 

5 3 = 0.78 

5 4 = 1.44 

5 5 = 1.02 

S c = 0.79 

6 

These ratio scale values for the overall effectiveness of 
six tank weapon systems will be discussed in the next 
section. 
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B. SYSTEM EFFECTIVENESS VALUES 

At last we have ratio scale values for the relative 
effectiveness of each tank as shown in Table V. 

Table V. EFFECTIVENESS OF SIX MAIN BATTLE TANKS 



TANK 


EFFECTIVENESS 


M48A5 


0.89 


M60A1 


1.22 


AMX-30 


0.78 


LEOPARD 1 


1.44 


T-62 


1.02 


CENTURION 
(Mk. 13) 


0 . 79 



If we represent these effectiveness values graphically, they 
would appear as in Figure 3. 



2.0-t 




u 

(it— 

LO 
1 — 1 


LEOPARD 1 


i — ■ ■ o 


M60A1 


1.0” 0 

i — o 

■ — S 

0.5 — 


T-62 
M4 8A5 
CENTURION 
AMX-30 


0 . 0 .. 





FIG. 3 EFFECTIVENESS OF SIX MAIN BATTLE TANKS 
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The effectiveness values calculated above and shown here 
are relative effectiveness values, and have no physical 
units . 

An advantage of using a scaling method which requires 
that the judges provide ratio scale information is that the 
output is also a ratio scale. This is very advantageous 
in interpreting the results in that, for example, we can 
say the Leopard 1 is more effective (or better) than the 
AMX-30 by 



1.44 - 0.78 
1.44 



x 100 



46 % . 



Such a statement would not be possible if the scale was 
interval or less. The effectiveness value by itself is 
meaningless, but because this is a ratio scale, we can 
compare the two systems directly by ratios , and can say 
how much better one is than the other . 

In this chapter we have computed the effectiveness 
of six tank weapon systems using the constant sum scaling 
method. This scaling approach provides an effective way of 
computing the overall effectiveness of weapon systems. 
However, this use of a scaling method alone requires that 
we have to send questionnaires everytime we want to calcu- 
late the effectiveness of, say, a new or different Main 
Battle Tank. This is because the effectiveness we computed 
is based on the information given by the judges, but not 
directly on the system characteristics . 
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In the next chapter, we are going to find a functional 
relationship between the effectiveness computed from the 
information given by the judges and the characteristics of 
systems. Such a relationship could be used in subsequent 
analyses instead of sending questionnaires. 
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IV. DETERMINATION OF A FUNCTIONAL RELATIONSHIP 
FOR SYSTEM EFFECTIVENESS 



In the previous chapter we computed the effectiveness 
of six Main Battle Tanks, and we have the characteristics 
of these systems from Chapter II. In this chapter, we 
are going to find a function which relates the character- 
istics to the effectiveness values. With the data shown 
in Table I (characteristics), tank characteristics can be 
thought of as explantory variables and the effectiveness 
can be thought of as a dependent variable for the multiple 
regression [2] analysis which will now be discussed. 

A. SEARCHING FOR A FUNCTIONAL RELATIONSHIP BETWEEN 
EFFECTIVENESS AND SYSTEM CHARACTERISTICS USING 
MULTIPLE REGRESSION 

Since there are six dependent variables (six Main 
Battle Tanks) and four explanatory variables (four character- 
istics) , computational work [4] is simplified with a 
computer program for linear and non-linear multiple 

regression. There exists a very useful APL computer 

2 

program for multiple regression named "REGRESS", which 
will be used to find a good functional relationship between 
effectiveness and system characteris tics . 

The "REGRESS" program does a multiple regression analysis 
relating the dependent variables Y to a set of explanatory 



2 



See Appendix B. 
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variables X. Here Y is a vector of size n and the right 
hand argument X is an nxm matrix consisting of n observa- 
tions on each of m variables, corresponding to the tank 
characteristic data in Table I. 

Output consists of an ANOVA table, coefficient of 

2 ... 
determination R , Standard Error SE, regression coefficients 

bj (the first coefficient is the constant term, a) , and a 

vector of predicted Y values and residuals. 

For the analysis, we used the computer program "REGRESS" 
on APL by taking 

(1) a linear combination of the character istics , or 

m 

Y- = a + l b. X. . , 

i 4 D ID 

j=l 

(2) a linear combination of logs of the characteristics, or 

m 

Y i = a + l bj log , 

j = l 

(3) a linear combination of logs of both the characteristics 
and effectiveness, or 



m 

Yj_ = exp (a + l bj log X^] , 

j=l 



31 



( 4 ) 



a linear combination of reciprocal of the character- 
istics , or 



m 



Y i = a + l b j ' 
j-1 13 



(5) a linear combination of reciprocal of both the 
characteristics and the effectiveness, or 



m 



Yj = (a + l b. , 

J-1 ’ lj 



(6) a linear combination of square root of the 
characteristics , or 



m 



Y i - 3 + l b j /X^ , 



j=l 



(7) a linear combination of reciprocal of square root 
of the characteristics , or 



m 

Yi = a + l b (— t-) , 

• , 3 /X. . 

3=1 lj 



and finally 
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(8) a linear combination of square root of both the 
characteristics and effectiveness, or 

Y. 

1 

From the computer output (see Appendix B) , the results 

2 

were obtained as shown in Table VI. Here R , the coefficient 

of determination, shows the proportion of total variance 

accounted for by the estimating equation as a measure of 

2 

dispersion, and thus a bigger R is better. The third 
column shows the standard error which is defined as the 
square root of the unexplained variance of the dependent 
variables Y. Therefore the smaller the standard error, 
the better the estimating equation. The F-ratio is defined 
as 



m 



= [a + l b j 
j = l 



p _ Regression mean square 
Residual mean square 

This F-statistic is used to test whether the incremental 
improvement associated with the addition of a variable is 
significant. Thus the larger the F-value the better. The 
last column shows the coefficient of variation which relates 
the standard error (SE) , to the mean of the dependent 
variables Y's, or 




y 



( 13 ) 
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Y. 

l 



Y. 

1 



Y. 

1 



Y i 



Y. 

1 



Y. 

1 



Y. 

l 



Y. 

1 



Table VI. SUMMARY OF RESULTS 



REGRESSION 




R 2 


SE 


F 


m 










a + y b.x. . 

j=l 3 m 




0.783 


0.267 


0.955 


m 










a + l b . log X. . 
j=l J 13 




0.888 


0 . 196 


1.978 


m 










exp[a+ l b. log X- •] 
j=l 1 ^ 


0.877 


0.194 


0.177 


m 1 

a+ j b j 

0=1 J io 




0.980 


0.083 


12.24 


m 

' a+ J, b j'x 

J=1 J 1] 


-1 


0.958 


0.110 


5 . 704 


m 










a + y b./5T~ 
j-1 D ^ 




0.838 


0.236 


1.29 


m 

a+ I b -i 




0.937 


0 . 147 


3.947 


m 

[ 3 . + y b. /x . . ] 

a ^ ^ 


C. 


0.333 


0.116 


1.249 


Y. : 
1 


Effectiveness 






a : 


Constant term 






b. : 
3 

X. . : 
13 


Coefficients 






Characteristic 


Data 


(Table I 



CV 



0.261 



0.192 



0.189 



0.081 



0.107 



0.231 



0.143 



0 . 113 
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This value is used in comparing one standard error with 
another; a lower CV value is better. 

B. SELECTION OF THE BEST EQUATION 

Looking at Table VI , the largest measure of dispersion 

2 

(R ) is 0.98. The smallest standard error is 0.083, the 
highest F-ratio is 12.24 and the smallest Coefficient of 
Variation (CV) is 0.081. Fortunately, all of these best 
values for measures of fit occur when we linearly combine the 
reciprocals of the data. Here the Coefficient of Variation 
(CV) is 8.1%, which tells us the estimating equation is 
fitted very well in this case. 

The coefficients^ that provided the good fitting function 

were 

-11.62 
-74.15 
27.93 
-622.54 
271 .94 

Therefore the best estimating relationship developed among 
those forms investigated is 



EFFECTIVENESS 



74.15 27.93 622.54 

ARMOR SILHOUETTE SPEED 



271.94 

Hp/hr 



(14) 



3 



See Appendix B. 
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The closeness of the fit of this function to the total 
effectiveness values furnished by the judges is shown, 
for individual points, in Table VII. 

Table VII. JUDGE EFFECTIVENESS VS FUNCTION EFFECTIVENESS 



TANK 


JUDGE 

EFFECTIVENESS 


FUNCTION 
EFFECT IVNESS 


DEVIATION 


PERCENT 

DEVIATION 


LEOPARD 1 


1.44 


1.46665249 


-0 . 266524897 


1.85% 


M60A1 


1.22 


1.165318586 


0.0546814318 


4 . 48% 


T-62 


1.02 


0.9953316577 


0.0246683423 


2.42% 


M48A5 


0.89 


0 .9391371068 


-0 . 0491371068 


5.52% 


CENTURION 
(Mk. 13) 


0.78 


0.8004486225 


-0 . 0104486225 


1.32% 


AMX-30 


0.78 


0.773111555 


0 . 0068884449 


0 . 88% 



We can see from Table VII that the percent deviations of 
effectiveness for the six weapon systems are all less than 
5.52%. This suggests that the estimating function of 
reciprocals of the data fits quite well the data upon which 
it was developed. 

Let's look at the results from another point of view. 

A common practice in attempting to evaluate the effectiveness 
of a weapon system is to use a simple linear combination of 
the characteristic values, with coefficients determined by 
any of several rather arbitrary ways. One approach which is 
rarely undertaken is to do as was dene in this paper, using a 
least square fit with effectiveness values obtained from 
experts ' j udgement . 
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Figure 4 shows the scatter plot of judge effectiveness 
vs function effectiveness estimated from a simple linear 
function of the characteristics , and Figure 5 shows the 
scatter plot of judge effectiveness vs function effective- 
ness estimated by taking the reciprocal of the characteristics. 

It can be seen at a glance that the function effective- 
ness estimated by taking reciprocal of the characteristics 
is much closer (better) to the judge effectiveness than 
function effectiveness estimated by just taking a linear 
combination of the characteristics. 

One possible reason why an estimating function using 
reciprocals of the characteristics is better fitted than 
the common procedure of evaluating the effectiveness of 
a weapon system using a simple linear combination of the 
characteristics, is that a property like system effective- 
ness may possess diminishing marginal returns with respect 
to increasing characteristic values. In the best fitting 
equation (reciprocals) the partial derivative of effective- 
ness with respect to a characteristic value (with a negative 
coefficient) was then the reciprocal of the square of the 
characteristic value, hence diminishing marginal returns. 

We have now developed a functional relationship between 
the characteristics and the effectiveness of tank systems 
as intended at the beginning of the study, and found that 
the best estimating equation among those considered occurred 
when a linear combination of a reciprocal of the character- 
istics was used. 
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JUDGE EFFECTIVENESS VALDES ' JUDGE EFFECTIVENESS VALUES 




JUDGE EFFECTIVENESS VALUES VS FUNCTION EFFECTIVENESS 
VALUES DETERMINED BY A LINEAR COMBINATION OF 
CHARACTERISTIC VALUES 




FIG. 5. JUDGE EFFECTIVENESS VALUS VS FUNCTION EFFECTIVENESS 
VALUES DETERMINED BY A LINEAR COMBINATION OF 
RECIPROCAL OF CHARACTERISTIC VALUES 
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The functional relationship developed in this manner 
could at least assist military planners in two ways: 

(1) in assessing the impact on effectiveness of a modifica- 
tion of characteristics of an existing tank, and (2) in 
evaluating the effectiveness of a new (and perhaps unbuilt) 
tank . 

We will summarize the results of our study and propose 
some recommendations for further study in the next chapter. 
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V. CONCLUSIONS AND RECOMMENDATIONS 



In this chapter we will give some conclusions from the 
study, and some suggestions for further study. 

A. CONCLUSIONS 

The principal purpose of this study was to determine 
whether we could compute the overall effectiveness of a 
weapon system from its characteristics, to establish the 
existence of functions which could be used to relate system 
characteristics and effectiveness, and to identify the best 
estimating relationship. To do this we proposed a procedure, 
sent appropriate questionnaires, and computed the overall 
effectiveness values for tank weapon systems by using the 
constant sum scaling method. Then, using multiple regression, 
we found functional relationships as in Table VI and 
evaluating these results we finally found that the best 
estimating equation occurred when we took the reciprocal, 
i . e. , 



m 



(Effectiveness) 




where 



a 



-11.6119 is an intercept, 




(-74.149,29.926,-622.536,291.944) , and 



X. . are characteristics (Table I) . 
ID 
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This is quite an interesting result because most people 
use a linear function in general. 

This approach is felt to have merit as a way of finding 
an overall MOE because it is based on the opinion of many 
experts. A conspicuous limitation in the tank example used 
here is that this study did not include tank characteristics 
relating to fire power, primarily because of the difficulty 
of data collection. 

The scaling for valuing system effectiveness is, of 
course, independent of the number of characteristics or 
presence of data on those characteristics. This provides, 
however, effectiveness values only for the instances listed 
in the questionnaire. Development of the functional rela- 
tionships between characteristics and effectiveness, unfor- 
tunately, requires more data points (instances on the ques- 
tionnaire) than characteristics if the function-finding 
approach used here is employed. 

B. RECOMMENDATIONS FOR FURTHER STUDY 

We have shown how to develop a model by which one can 
compute the system effectiveness directly from its charac- 
teristics. However we feel that we don't know how good our 
model is. To test our model, we suggest the following 
method which could be part of a further study. 

(1) Select instances A.B.C.D.E (or any number of 
instances) 

(2) Send questionnaires on A.B.C.D. (excluding instance 

E. ) . 
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(3) 



Find the best function 



Y. 

1 



f(X, ,X_, . .., X ) 

1 z m 



(4) Predict the Y value using the above estimating 

Ij 

equation. 

(5) Send questionnaires on A.B.C.D.E (including the 
excluded instance) . 

(6) Compute the Y„ value using the constant sum scaling 

Cj 

method and expert opinion. 

(7) Comparing those two effectiveness values computed 
in step (4) and (6), provides a test of our model. 



It is hoped that the work presented here will be useful 
to both those interested in tank effectiveness measurement 
and those concerned with multiple MOE research problems. 
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appendix a 
QUESTIONNAIRE 
PROBLEM DESCRIPTION 



A fundamental problem in Operations Research is that of satisfactorily 
combining various MOEs for a system into a single measure of overall 
effectiveness. A variety of methods have been used out of necessity, with 
the weighted sum of MOEs being perhaps the most frequent expedient. However, 
both the values of the weights and the notion of adding the MOEs are usually 
difficult to justify, and this approach often yields results which differ 
sharply from expert judgment. 

The premise of our study at NPS is that individuals with expertise 
regarding the phenomenon (in our case, tanks) possess judgmental ways of 
combining MOEs which are far superior to the analyst’s simple weighted 
average. The difficulty is that the expert usually cannot tell us how 
he knows, say, that on the basis of given data Tank A is superior to Tank B. 

Our investigation seeks a procedure to approximate the way experts 
put MOEs together to form a single measure of effectiveness. This approach 
crosses disciplinary lines in that we use scaling techniques from the 
behavioral sciences together with nonlinear regression methods from statistics. 

The heart of the approach, of course, is data from knowledgeable people, 
obtained through a specialized- questionnaire . The research is still in 
its infancy, and the current effort seeks a small amount of data about 
a reduced set of MOEs, for use in development and assessment of this 
approach. 

Degree Candidate: H.B. Kim, Lt, Col., Korean Army 

Adviser: G.F. Lindsay, Assoc. Prof, of Operations Research, Naval Postgraduate 

School. 

24 October, 1978 
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EFFECTIVENESS OF A TANK WEAPONS SYSTEM 



A study is being made of various measures of effectiveness applicable 
to a tank, and how they relate to overall effectiveness. Judgments reflect- 
ing your experience and expertise are solicited. 

Both parts of this questionnaire have purposefully been kept short, and 
we ask only two or three minutes of your time. 

A. Importance of Tank Effectiveness Factors . 

Please split 100 points within each pair listed below, assigning a higher 
number to a factor you think is more important. For example, if you think 
that fire power is much more inportant than armor, you might split the 100 
points as follows: 

Fire Power 80 , Armor 20 

Or, if you thought them to be equal in importance, you would write: 

Fire Power 50 , Armor 50 . 

Omit pairs you feel unable to rate. 



1. 


Range , 


Road 


t 


Fire Power 


2. 


Range , 


Road 


t 


HP/ton 


3. 


Range , 


Road 


t 


Armor 


4. 


Range , 


Road 


t 


Speed 


5. 


Range , 


Road 


t 


Silhouette 


6 . 


Speed 




t 


Fire Power 


7. 


Speed 




t 


HP/ton 


8. 


Speed 




t 


Armor 


9. 


Speed 




t 


Silhouette 


o 

* — i 


Fire Power 


t 


HP /ton 


* — t 
i — i 


Fire Power 


t 


Armor 


12. 


Fire Power 


t 


Silhouette 


13. 


HP/ton 




t 


Armor 


14. 


HP /ton 




t 


Silhouette 


15. 


Armor 




t 


Silhouette 
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B . Overall Combat Effectiveness of Existing Tank Weapons Systems 



FACTORS 


M48AI , 


M60A1 


AMX-30 


LEOPARD 1 


T-62 


CENTURION 
(Mk . 13) 


RANGE , ROAD 
(km) 


482 


500 


650 


600 


500 


190 


FIRE POWER 
(main gun) 


105 


105 


105 


105 


115 


105 


SPEED 
(km/ hr) 


48.2 


48.3 


65 


65 


50 


34.6 


HP/ton 


15.9 


15.3 


19.4 


20.7 


19.2 


12.5 


ARMOR 

(mm on nose) 


110 


110 


40 


70 


100 


113 


SILHOUETTE 
(height in m) 


3.09 


3.26 


2.85 


2.64 


2.4 


3.01 



Some characteristics of six current tanks are shown above. Please 
split 100 points within each pair listed below, in terms of the overall 
effectiveness of the tank weapons system. 



1 . 


M48A5 


t 


M60A1 


2. 


M48A5 


t 


AMX-30 


3. 


M48A5 


/ 


LEOPARD 1 


4. 


M48A5 


/ 


T-62 


5. 


M48A5 


t 


CENTURION 


6. 


T-62 


t 


M60A1 


7. 


T-62 


t 


AMX-30 


8. 


T-62 


f 


LEOPARD 1 


9. 


T-62 


t 


CENTURION 


10. 


AMX-30 


/ 


M60A1 


11. 


AMX-30 


t 


LEOPARD 1 


12. 


AMX-30 


r 


CENTURION 


13. 


CENTURION 


r 


M60A1 


14. 


CENTURION 


t 


LEOPARD 1 


15. 


LEOPARD 1 


t 


M60A1 



Thank you very much for your time and cooperation. 



2 
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APPENDIX B 



MULTIPLE REGRESSION OUTPUT ON APL 



yREGfiFssrmv 

* Z<-Y REGRESS X > N > K > C > XF'XINV ? XF'Y > BETA r RSS > TSS > S2 > ESS > WID » DEF' 

1:1:1 x +- c 2 1 ( ? x > » i ) p x 

C2I! X<-<0> 1-a INTERCEPT) II rX 

II 3 H XPXINVH3<*X>+ .xX 

C4H BETA<-XPXINV+ . xXF'Y<- (NX ) + ♦ x Y 

CS3 RSS*- < (NBETA) + .xXPY)-C<-( ( f /Y ) *2 ) -N*-p r Y 

€61 ESS+- ( TSS<- ( (NY)+.xY)-C)-RSS 

€71 S2<r f ESS-r ( N- 1 ) -K> ( P r BETA) -A INTERCEPT 

C83 CR 

€91 ' ANOVA' 

IIIO'J CU<- 1 SOURCE > DF > SUM SQUARES * MEAN SQUARE > F-RATIO ‘ 

€111 ' ' 

Cl 2 II 1 13REGRESSIONI3? I4r BE1 6 ♦ 4 1 FMT(K) > ( ? RSS ) > ( >RSS-K) , ( , RSS*K > *S2 
II 1311 CU*-' 1 

C 1 4 3 '□ RESIDUALS I4>BEl6.4' FMT ( ( N~1 ) -K ) > ( » ESS > „ S2 » 0 

111511 1 CITQTAL D>I4>BE14.4' FMT ( N-l ) > ( > TSS ) r 0 > 0 

€161 ' ' 

C 1 7 3 ' R SQUARE: 1 5 t RSS-^TSS 

II 1 8 U 'STD ERROR: ' 5 r S2*0 . 5 

C19D CU*- ' COEFFICIENTS r T STATISTICS' 

C203 ' FI 5 . 4 ' FMTN ( 2 > p > BET A ) p ( > BET A ) > ( » BET A ) - ( 1 1 NV«-S2xXPXINV ) *0 * li 

5 

112111 'DO YOU WANT A PRINTOUT OF THE VARIANCE-COVARIANCE MATRIX?' 
€221 -‘A1X X 1 Y 1 *1 tn 

€231 'VARIANCE-COVARIANCE MATRIX: ' 

€241 ' El 2 * 4 ' FMT V 

€231 Ai: ' DURBIN-WATSONJ ' J <+/<<14»C)-<"14*C))*2)-H-/< ? C<-Y-Xf . xBETA ) *2 
11263 Z*-N< 2>N) p ( t X+ . x BET A ) » >C 

C273 Bi:*DO YOU WANT TO FORECAST A VALUE FOR Y? ' 

11283 -»C1 x t 'Y'-ltd 

C2?3 'ENTER X VECTOR ( ' 5 K ? ' VALUES)' 

€301 'FORECAST OF Y VALUE: ' ? <C«-< 1-alNTERCEPT) 41 »□) + . xBETA 

11313 'VARIANCE OF FORECAST ERROR: 1 * S2x 1+C+. XXPXINV+ . x*C 

C323 -*B1 

C333 CIJ'DO YOU WANT TO SCAT RESIDUALS VS* PREDICTED Y? ' 

€341 -»0x i ' N ' =1 tD 

C 35 1 DEP+-0 . 5xWIEh-L/ 70 » (f/( (0.75xN) >30) ) 

11363 SCAT Z 

■7 
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70 

110 

100 

110 

118 

40 



2.64 



65 



20.7 



3.26 



48.3 



15.3 



2.4 


50 


3.09 


48.2 


3.01 


34.6 


2.85 


65 



15 . 

12 . 

1 . 9.4 



Y 

1.44 1.22 1.02 0.89 0.79 0.78 
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cn 'O r 



Y REGRESS X 



A NOV A 



SOURCE DP 
REGRESSION 4 
RESIDUAL 1 
TOTAL 5 



SUM SQUARES 
2 * 7245E“1 

i -n i”\ / r* — o 

/ + .i. <•— OL -W. 

3 . 4373E"! 



MEAN SQUARE 
6 . SI 12E“2 
7 » 1286E'"2 



•RATIO 

547E“1 



R SQUARE X 0.7926120 


129 


S T D E R R 0 R X 0.2 6 6 9 9 4 6 3 9 3 


COEFFICIENTS T 


STATISTICS 


2.3063 


0.3699 


0.0251 


1 . 4535 


“1.6073 


“0.7715 


0.1405 


1.0579 


“0.3682 


“0.764 



DO YOU Ul A N T A 
Y 

U A R IANCE—CG V A R 


PRINTOUT OF 


THE VARIANCE' 


-COVARIANCE 


MATRIX? 


IANCE MATRIX 








4. 1616E+1 


7 . 3596E“2 


“1 . 2C16E-M 


7 . 3632E” 1 


“2.8942E00 


7 . 3596E“2 


2 . ?907E“4 


“3 . 0556E“2 


2. :L26SE“3 


“7,1 S47E”3 


“1 .2816E+1 


'"3 . 0556E“2 


4 . 3399E00 


— • < cr cr -*r | i 


9 , 8432E“1 


7 . 36S2E“1 


2 > 1263E“3 


“2.6553E“1 


■j -7 <; *r*rirT* 

•L -i i 'JUJL. 


“6 , 3026E~2 


“2 ♦ 8942E00 


“7. 1847E“3 


9 . 8432E“1 


“6 . 3026E“2 


■-) ~T -/ -y r~ — * 

+ s j +— <2. 4. 


durbin-watson: 


2.006601651 








DO YOU WANT TO 


FORECAST A 


VALUE FOR Y? 







N 

DO YOU WANT TO SCAT RESIDUALS US. PREDICTED 
Y 

RANGE OF XJ 0.6 1.6 

iANGE OF YJ “0.25 0.2 






A o 

V. 


./ 

.4 


1.410903046 


0.02909695409 


1.062459362 


0.1575406384 


0 * 9959965683 


0.02400343169 


1.100700476 


“0.2107004762 


0,7719477676 


0.01305223238 


0.7979927803 


“0 , 0179927803 
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\ 



- 



1 



Y REGRESS *X 



ANOVA 



SOURCE 


DF 


SUM SQUARES 


MEAN SQUARE 


F-RATIO 


REGRESSION 


4 


3 . 0517E"1 


7 . 6292E"2 


1 .9782E00 


RESIDUAL 


1 


3 . 8565E"2 


3 * 8565E~2 




TOTAL 


5 


3 . 4373E" 1 







R SQUARE: 0.8878042559 

STD ERROR*. 0.1963807962 



COEFFICIENTS 
"4 . 6385 
1 . 5055 
"7.2268 
9.6399 
"11.0647 



T STATISTICS 
" 1 .0011 
2.3534 
"1 . 4786 
1.7563 
"1.5005 



DO YOU WANT A PRINTOUT OF THE VARIANCE-COVARIANCE MATRIX? 



VARIANCE-COVARIANCE MATRIX: 

2.1 470E+1 "9 ♦ 4373E"2 "1.1615E+1 9.0073E00 

"9 . 4373E"2 4.0924E"1 "2.5707E00 3.1039E00 

"1 . 1615E+ 1 "2 ♦ 5707E00 2.3888E+1 "2.6094E+1 

9.0073E0O 3 . 1039E00 "2.6094E+1 3.0126E+1 

" 1 . 5628E+ 1 "3 . 9644E00 3.5500E+1 "4.0196E+1 

durbin-uatson: 2.080517414 

DO YOU WANT TO FORECAST A VALUE FOR Y? 

N 

DO YOU WANT TO SCAT RESIDUALS VS. PREDICTED Y? 

Y 

RANGE OF X: 0.6 1.6 

RANGE OF Y: "0.15 0.15 



"1 .5628E+1 
"3 . 9644E00 
3 . 5500E+1 
"4 . 0196E+1 
5 . 4374E+1 



o 



o 



o o 



o 



o 



1.455072367 


"0.01507236729 


1.093099258 


0.1269007416 


0.9840070802 


0.03599291975 


1.034541009 


"0.1445410085 


0.7961936605 


"0.006193660469 


0.777086625 


0.002913375008 
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1 



(«Y) REGRESS (*X) 



ANOUA 



SOURCE 


DF 


SUM SQUARES 


MEAN SQUARE 


F-RATIO 


REGRESSION 


4 


2.6622E"! 


6 . 6555E"2 


1 .7746E00 


RESIDUAL 


t 


3 . 7504E"2 


3 . 7504E"2 




TOTAL 


5 


3.0373E"! 







R SQUARE.* 0.87651981.75 
STD ERROR.* 0.1936598687 



COEFFICIENTS 

"6.0277 

1.3669 

"5.9679 

8.1447 

"9.1104 



T STATISTICS 
"1.3192 
2.1668 
"1.2382 
1.5047 
"1.2529 



DO YOU WANT A PRINTOUT OF THE OAR I ANCE-COUAR I ANCE MATRIX? 



2. 0879E+1 
'9 . 1 776E"2 
’I . 1295E+1 
8 . 7594E00 
'1 .5198E+1 



’9. 1776E"2 
3.9798E"! 
'2 ♦ 5000E00 
3 . 0185E00 
"3 . 8553E00 



'1 . 1295E+1 
'2 . 5O00E00 
2.3231E+1 
'2.5376E+1 
3 . 4523E+ 1 



8. 7594E00 
3 . 0185E00 
'2 . 5376E+1 
2 . 9297E+ 1 
'3 . 9090E+ 1 



durbin-ujatson: 2.080517414 

DO YOU WANT TO FORECAST A UALUE FOR Y? 

N 

DO YOU WANT TO SC.°>T RESIDUALS OS. PREDICTED Y? 
Y 

RANGE OF X. 4 "0.4 0.4 

RANGE OF Y: "0.15 0.15 



‘1 .5198E+1 
’3 . 8553E00 
3 . 4523E+ 1 
‘3.9090E+1 
5 . 2878E+ 1 



o 



o o 



o 



o 



0.3795066478 

0.07370837312 

"0.01569159746 

0.02600452402 

"0.2296144885 

"0.2513343684 



"0.01486353417 
0. 1251424856 
0.03549422475 
"0.1425383403 
"0.006107845058 
0.002873009127 



50 



im 



i 



Y REGRESS TX 



ANOVA 



SOURCE DF 
REGRESSION 4 
RESIDUAL 1 



SUM SQUARES 
3 « 3685E~1 
6 . 8800E - 3 



TOTAL 



5 3 . 4373E~1 



MEAN SQUARE 
8 * 4213E~2 
6 . 8800E~3 



R SQUARE: 0.9799844232 


STD ERROR.* 0.08294 


589169 


COEFFICIENTS 


T STATISTICS 


"11.6119 


"3.4369 


"74.1488 


"6.2379 


27.9259 


4.2011 


“622.5395 


"4.6658 


271.9441 


4.2671 



DO YOU WANT A PRINTOUT OF THE VARIANCE-COVARIANCE 



Y 

VARIANCE-COVARIANCE MATRIX : 

1.1415E1 2.7450E1 "2.2374E1 

2 ♦ 7450E1 1.4130E2 "5.7579E1 



4.3981E2 
1 .2390E3 



"2.2374E1 
4. 3981E2 
"2. 1281E2 



"5. 7579 El 
1 .2390E3 
"5.6655E2 



4. 4187E1 
“8 « 7077E2 
4 . 1 895E2 



“8. 7077E2 
1 ♦ 7803E4 
"8.4757E3 



DURBIN-WATSON l 2.145430874 

DO YOU WANT TO FORECAST A VALUE FOR Y? 

N 

DO YOU WANT TO SCAT RESIDUALS VS. PREDICTED Y? 
Y 

RANGE OF X! 0.6 1*6 

RANGE OF Yt “0.06 0.06 



o 



o 



o 



o 



<3 



o 



1 . 46665249 

1 . 165318568 

0.9953316577 

0.9391371068 

0.8004486225 

0.773111555 



"0.02665248971 

0.05468143179 

0.02466834227 

"0.04913710681 

"0.01044862252 

0.006888444973 



F-RATIO 
1 .2240E+1 



MATRIX? 



"2. 1281E2 
"5.6655E2 
4. 1895E2 
"3.4757E3 
4.0615E3 
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I 



11±I> REQR&SSL LUjLL 



AN OVA 



SOURCE 


DF 


SUM SQUARES 


MEAN SQUARE 


REGRESSION 


4 


2.7511E“1 


6 « 8777E“2 


RESIDUAL 


1 


1 . 2058E“2 


1 .2053E“2 


TOTAL 


5 


2.871 7E“1 





R SQUARE: 0.9580105484 

STD ERROR: 0.1098086393 

COEFFICIENTS T STATISTICS 


9.9859 


2.2326 


65.7943 


4.181 


“20.6599 


“2.3477 


471.4091 


2.6688 


“200.6539 


“2.3783 



DO YOU WANT A PRINTOUT OF THE VARIANCE-COVARIANCE 
Y 

VARIANCE-COVARIANCE MATRIX: 

2 . 0005E1 4 . 8109E1 “3.9213E1 7.7082E2 

4 . 8109E1 2 . 4764E2 “1.0091E2 2.1714E3 

“3.9213E1 "1 . 0091E2 7.7442E1 “1.5261E3 



7 . 7082E2 2 ♦ 1 71 4E3 “1.5261E3 3.1201E4 

“3.7296E2 “9.9294E2 7.3424E2 “1 . 4854E4 

durbin-uatson: 2.145430874 

DO YOU WANT TO FORECAST A VALUE FOR Y? 

N 

DO YOU WANT TO SCAT RESIDUALS VS. PREDICTED Y? 

Y 

RANGE OF X: 0.6 1.4 

RANGE OF YI "0.08 0.08 



o 



o 



0.6591603144 


0.03528413003 


0.8920626197 


“0.07239048852 


1.013049556 


“0.03265739921 


1.05854492 


0.06505058572 


1.251990285 


0.01383249969 


1.29117061 


“0.00911932772 



F-RATIO 
5 . 7039E00 



MATRIX? 



“3 . 7296E2 
“9.9294E2 
7.3424E2 
“1 .4854E4 
7. 1182E3 
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Y REGRESS X».5 



ANOVA 



SOURCE OF 
REGRESSION 4 
RESIDUAL 1 
TOTAL 5 



SUM SQUARES 
2.8793E“1 
5 . 5799E“2 
3 . 4373E“1 



R SQUARE. 4 0.8376671578 
STD ERROR: 0.2362185618 




COEFFICIENTS T STATISTICS 


9.6981 


0.7228 


0.3986 


1.8048 


“7.0421 


“1.0655 


2.3585 


1.3374 


“4.2137 


“1.0744 



MEAN SQUARE 
7 . 1 984E“2 
5 . 5799E“2 



Y 

VARIANCE-COVARIANCE MATRIX: 



1 .8003E+2 
2. 1507E00 
“8 . 6857E+1 
2. 1746E+1 
“5 . 06.10E+1 
DURBI N-UATSON : 



2 . 1507E00 “8 . 6857E+ 1 2.1746E+1 

4 . 8783E“2 “1.2281E00 3.5430E"! 

'1 . 2281E00 4.36S3E+1 "1.1273E+1 

3 . 5430E“1 “1 4 1273E+1 3.11O1E00 

"7 . 4316E“1 2 4 5479E+ 1 “6.8470E00 

2.038119584 
DO YOU WANT TO FORECAST A VALUE FOR Y? 

N 

DO YOU UANT TO SCAT RESIDUALS VS. PREDICTED Y? 



RANGE OF X. 4 0.6 1.6 

RANGE OF Y: “0.2 0.15 



1.434688413 


0.005311587208 


1.073082645 


0.1469173555 


0.988212396 


0.03178760399 


1.071996205 


“0. 181996205 


0.7859517492 


0.00404825083 


0.7860685924 


“0.006068592406 



F-RATIO 
1 .2900E00 



MATRIX? 



“5 . 0610E+1 
“7 . 4316E“1 
2 . 5479E+1 
“6 . 8470E00 
1 .5381E+1 
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1 



Y REGRESS <l-rX».5) 



ANOVA 



SOURCE 


DF 


SUM SQUARES 


MEAN SQUARE 


REGRESSION 


4 


3 ♦ 2224E“ 1 


8 . 0559E“2 


RESIDUAL 


1 


2. 1497E“2 


2. 1497E“2 


TOTAL 


5 


3.4373E"! 





F-RATIO 
3 . 7474E00 



R SQUARE: 0.9374595357 

STD ERROR: 0.1466193789 




COEFFICIENTS 


T STATISTICS 


“18.7584 




“1.7598 


“21.7109 




“3.367 


28.7162 




2.2021 


“155.6577 




“2.5165 


111.2614 




2.2382 



DO YOU WANT A PRINTOUT OF THE VARIANCE-COVARIANCE 
Y 

VARIANCE-COVARIANCE MATRIX: 



1 . 1362E2 
5 ♦ 0221E1 
“1 .3817E2 
6 ♦ 3622E2 
“5.21 18E2 

durbin-watsqn: 

DO YOU WANT TO 
N 

DO YOU WANT TO 



5 * 0221E 1 “1.3817E2 6.3622E2 

4 . 1580E1 “6.62S4E1 3.3699E2 

“6 . 6284E 1 1 ♦ 7005E2 “7.3844E2 

3 ♦ 3699E2 “7.8844E2 3.8260E3 

“2 ♦ 5875E2 6.3979E2 “3.0602E3 

2 ♦ 1221 15702 

FORECAST A VALUE FOR Y? 

SCAT RESIDUALS VS ♦ PREDICTED Y? 



MATRIX? 



"5*21 18E2 
“2 ♦ 5875E2 
6 * 3979E2 
”3 ♦ 0602E3 
2.4711E3 



Y 

RANGE OF XI 0.6 1*6 

RANGE OF r. '0,1 0.1 



o 



J l. 467833212 
1 . 12315161 
0.9852532576 
0.9897234947 
0.8015763548 
0.7724620716 



“0.02783321172 

0.09684839049 

0.03474674236 

“0.09972349474 

“0.01157635483 

0.007537928422 
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(Y*.5) REGRESS (X*.5) 

ANOVA 



SOURCE DF 
REGRESSION 4 
RESIDUAL 1 
TOTAL 5 



SUM SQUARES 
6 . 6737E~2 
1 * 3354E~2 
8 . 0091 E“2 



MEAN SQUARE 
1 .6684E~2 
1 . 3354E"2 



R SQUARE! 0.8332679272 
STD ERROR: 0.1155581755 

COEFFICIENTS T STATISTICS 


4.6632 


0.7104 


0.1884 


1.7438 


"3.1607 


"0.9776 


1.076 


1.2472 


"1.8862 


"0.9831 



Y 

VARIANCE-COVARIANCE MATRIX.* 



5 . 2041E00 
8. 4790E"2 
2 . 6978E00 
7.4430E“1 
1 .6386E00 



4 . 3085E+1 5 ♦ 1 469E"1 "2.0786E+1 

5 . 1 469E~1 1 . 1675E~2 "2.9389E"! 

“2 ♦ 0786E+ 1 "2 ♦ 9389E" 1 1.0454E+1 

5 ♦ 2041E00 8 ♦ 4790E~2 "2.6978E00 

"1.2112E+1 "1 . 7785E~1 6.0975E00 

DURBIN-UATSON: 2.038119584 
DO YOU WANT TO FORECAST A VALUE FOR Y? 

N 

DO YOU WANT TO SCAT RESIDUALS VS. PREDICTED Y7 
Y 

RANGE OF X: 0.85 1.2 

RANGE OF YI '0.1 0.1 



1 . 19740157 

1 . 032664097 

0.9943999906 

1.032430699 

0.8868390365 

0.8861448434 



0.002598429701 
0.07187200443 
0.01555050326 
’0.08903258577 
0.001980405251 
56811 



F-RATIQ 
1 ■» 2494E00 



MATRIX? 



"1 .2112E+1 
“1 .7785E"! 

6 . 0975E00 
“1 .6386E00 
3 . 6810E00 
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APPENDIX C 



COMPUTATION OF A RATIO SCALE OF THE 
IMPORTANCE OF SIX MAJOR FACTORS OF 
A TANK WEAPON SYSTEM, USING THE 
CONSTANT SUM SCALING METHOD 



As a supplementary study, we computed a ratio scale 
of the importance of six major factors of a tank weapon 
system. The factors were: 

Road Range , 

Fire Power, 

Speed , 

Hp/ton , 

Armor, and 
Silhouette. 

As we did in Chapters II and III for system effectiveness, 
we followed the same procedure, i.e., we selected the 
major factors, collected data, selected the constant sum 
scaling method, sent questionnaires together with the ques- 
tionnaires for tank weapon system (Appendix A) , and computed 
the ratio scale values about the importance of each of the 
six major factors. 

The a^ j array was computed from the 50 judges responses 
and we computed the W — array from this a^ array by taking 
the ratio of the average points awarded to instance j (when 
compared to instance i) to the average points awarded to 
instance i (when compared to instance j). After constructing 
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the W ± j array we used equation (11) 



i • e . , 



n 

Sj = l (W ij ) 1/n , j = 1,2, . .., n 
i=l 

to get the ratio scale values of factors. The ratio scale 
values computed are shown in Table C, and represented 
graphically in Figure a. 



Table A. ARRAY COMPUTED FROM JUDGES RESPONSES 





RANGE, 

ROAD 


FIRE 

POWER 


SPEED 


HP/TON 


ARMOR 


SILHOUETTE 


RANGE, ROAD 


50 


75 


58.7 


59.8 


66 


63.3 


FIRE POWER 


25 


50 


32.5 


30.7 


38.3 


36.6 


SPEED 


41.3 


69.5 


50 


43.1 


58.7 


55.6 


HP/TON 


42.2 


63.3 


50.9 


50 


59.3 


54.7 


ARMOR 


34 


61.9 


41.3 


42.7 


50 


55.5 


SnHOUETTE 


36.4 


63.4 


44.4 


45.3 


54.5 


50 
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Table B 


W i ^ ARRAY 






RANGE, 


FIRE 










ROAD 


PCWER 


SPEED 


HP/TON 


ARMOR 


RANGE, ROAD 


i 


3 


1.421 


1.369 


1.941 


FIRE PCWER 


.333 


1 


.481 


.443 


.621 


SPEED 


.703 


2.099 


1 


.965 


1.421 


HP/TON 


.730 


2.259 


1.037 


1 


1.342 


ARMOR 


.515 


1.611 


.703 


.745 


1 


SILHOUETTE 


.592 


1.932 


.798 


.828 


1.198 


s j ' 


.61 


1.84 


.86 


00 


1.18 



Table C RATIO SCALE OF SIX MAJOR 
FACTORS OF TANK WPN. SYS. 



FACTORS 
FIRE POWER 
ARMOR 
SILHOUETTE 
SPEED 
HP /TON 
RANGE, ROAD 



RATIO SCALE 
1 . 84 
1.18 
1.04 
0.86 
0.84 
0.61 



suhoueite 

1.949 

.599 

1.252 

1.209 

.835 

1 

1.04 
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2.0 



1.5 

1.0 

0.5 

0 

FIG. < 



o EIRE POWER 



4 ARMOR 

SILHOUETTE 
^ SPEED 

"° HP/TON 
o RANGE , ROAD 



RATIO SCALE OF SIX MAJOR FACTORS 
OF TANK WEAPON SYSTEM 
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